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(54)Tltle: AN APPARATUS FOR GONDUCIING A lEST 
(57) Abstract 



There ts disclosed an apparatus in the fomi 
of a personal computer (1) for conducting a test 
on a candidate. The computer includes a desktop 
unit (2) which houses a motherix>aid, one or 
more CPU's and any necessary peripheral drivers 
and/or networic cards, none of which are explicitly 
shown. Onnputer (I) also includes first means in 
die form of a screen (3) for presenting a series 
of questions to the candidate. Also provided are 
second means in the form of a keyboard (4) for 
obtaining trom die candidate an answer to each of 
the questions. Hie CPU included within computer 
(1) includes timer means whidi, in diis case, is 
utilised for determinmg the time taken for the 
candidate to answer each of die questions. 
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TITLE: AN APPARATUS FOR CONDUCTING A TEST 

FIELD OF INVENTION 

The present invention relates to testing and in particular to an apparatus for 
conducting a test. 

S The invention has been developed priniarily for testing the suitability of a 

candidate to work in a predetermined position within an organisation and will be 
described hereinafter with reference to that application. However, the invention is not 
limited to that particular field of use and is also suitable for conducting other tests. 
BACKGROUND OF THE INVENTION 

10 Hitherto, it has been known to subject candidates applying for a position within an 

organisation to a written test This testing is intended to provide the potential CTiployer 
with an indication of the relative strengths and weaknesses of the candidates and whether 
any are well suited to the position or positions on ofiTer. 

Testing of this kind is usually in the form of one or more sets of multiple choice 

1 5 questions although other forms of questions are used in some tests. The questions are 
generally set out on a question ps^ which is provided to the candidates for a 
predetermined time. During this time the candidates must mark respective separate 
answer sheets with a pencil or pen to signify their choice of answer to the questions. At 
the end of the predetermined time the answ^ sheets are collected and collated for 

20 subsequmt analysis. Is also known to utilise tests which are not timed 

Such testing is labour intensive and time consuming. Another major disadvantage 
is that the results fiom such tests are highly susceptible to error due to scoring mistakes 
by the tester. Additionally, error susceptibility easily arises should the candidate guess 
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the answers. 

DISCLOSURE OF THE INVENTIQN 

It is an object of the present invention, at least in the preferred embodiment, to 
overcome or substantially ameliorate at least one of the disadvantages of the prior art, or 
5 at least to provide a useful choice. 

According to a first aspect of the invention there is provided an ^paratus for 
conducting a test on a candidate, the ^aratus including: 

first means for presenting a series of questions to the candidate; 

second means for obtaining fiom the candidate an answer to each of the questions; 

10 and 

timer means for determining the time taken for tiie candidate to answer each of the 
questions. 

Preferably, the apparatus includes third means for obtaining &om the candidate an 
indication of tfadr confidmce that any one or more of the answers were correct 
15 According to a second aspect of the invention there is provided an apparatus for 

conducting a test on a candidate, the apparatus including: 

first means for presenting a series of questions to the candidate; 

second means for obtaining fix>m the candidate an answer to each of the questions; 

third means for obtaining fiom the candidate an indication of their confidence that 
20 any one or more ofthe answers were correct; and 

timer means for detemuning the time taken for the candidate to answer the 
questions. 

Preferably, the timer means determines the time taken for the candidate to answer 
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each question. 

Preferably also» the first means sequentially presents the series of questions. Even 
niore preferably, the answers to the questions, once provided by the candidate, can not be 
. changed. 

5 In a preferred form, the third means allows the candidate to nominate one of a 

plurality of confidence bands which best corresponds with their confidence that an 
answer was correct More preferably, at least some of the questions are multiple choice, 
wherein the number of choices being available corresponds to the number of confidence 
bands. In other embodiments the third means prompts the candidate to provide a number 
10 within a predetemiined range to indicate their degree of confidence. 

Preferably, the apparatus includes fourth means responsive to the first means, the 
second means and flie timer means for indicating the results of the test. 

According to a ttiird aspect of the invention there is provided a method for 
conducting a test on a candidate, the method mcluding the steps of: 
IS presenting a series of questions to the candidate; 

obtaining fix>m the candidate an answer to each of the questions; and 
determining the time taken for the candidate to answer each of the questions. 
Preferably, the metiiod includes the additional step of obtaining fix>m the candidate 
an indication of their confidence that any one or more of the answers were correct 
20 According to a fourth aspect of the invention tiiere is provided a method for 

conducting a test on a candidate, the method including the steps of: 
presenting a series of questions to the candidate; 
obtaining fix)m the candidate an answer to each of the questions; 
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obtaining fiom the candidate an indication of their confidence that any one or more 
of the answers were correct; and 

determining the time taken for the candidate to answer flie questions. 

Preferably, the mettiod includes the step of determining the time taken for the 
5 candidate to answer each question. 

Preferably also, the series of questions is sequentially presented. Even more 
preferably, the answers to the questions, once provided by the candidate, can not be 
changed. 

In a preferred form, the candidate must nominate one of a plurality of confidence 
10 bands which best corresponds with their confidence that an answer was correct More 
preferably, at least some of the questions are multiple choice, wh^ein the number of 
choices being available corresponds to the number of confidence bands. In other 
embodiments the candidate is prompted to provide a number within a predetermined 
range to indicate their degree of confidence. 
15 Preferably, the method includes the step of indicating the results of the test. 

BRIEF DESCRIPTION OF THE DRAWINGS 

A prefored ^bodiment of the invention will now be described, by way of 
example only, with reference to the accompanying drawings and Tables, in which: 
Figure 1 is a schematic representation of an apparatus according to the invention; 
20 Figure 2 is a schematic representation of a number of like ^aratus interconnected 

to allow simultaneous testing of a number of candidates; 

Tables 1 , 2, and 3 illustrate scores achieved by candidates for Fluid Intelligence, 
Crystallised Intelligence and Quantitative Knowledge respectively; 
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Table 4 provides summaiy statistics for the data provided in Table U 2 and 3; and 
Table S provides a summary of the indicative resuhs provided by the various tests. 
PREFERRED EMBODIMENTS OF THE INVENTION 

Referring to Figure 1 , there is shown an apparatus in the form of a personal 
5 computer 1 for conductmg a test on a candidate. The computer includes a desktop unit 2 
which houses a motherboard, one or more QPlPs and any necessary peripheral drivers 
and/or network cards, none of which are explicitly shown. Computer 1 also includes 
first means in the form of a screen 3 for presenting a series of questions to the candidate. 
Also provided are second means in the form of a keyboard 4 for obtaining &om the 
10 candidate an answer to each of the questions. As would be s^reciated by those skilled 
in the computing art, the CPU included within conqputer 1 includes timer means which, 
in this case, is utilised for determining the time taken for the candidate to answer each of 
the questions. 

More particularly, computer 1, once mitialised, sequentially displays on screen 3 a 
IS series of questions. By way of illustration these questions will be designated as qi , q2, 
. . ., q„. As a question is displayed the candidate is prompted to choose one of a plurality 
of answers, only one of which is correct. By way of illustration these answers will be 
designated as ai, a2, . . a„. The candidate effects their choice, in this embodiment, by 
using keyboard 4 to type a number which correq[)onds to the number displayed on the 
20 screen as designating the answer selected by the candidate. In other CTibodiments the 
candidate effects the choice by moving a cursor across screen 3 in response to 
manipulation of either keyboard 4 or a mouse (not shown). In still fiuther embodiments 
use is made of a specialised input device for allowing the candidate to enter their choice. 
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For example, a numeric keypad or a joystick. 

As each question qi, q2> • • qn is displayed and the respective answer a|, a2, . . 
sequentially given, computer 1 calculates the respective time periods t|, tj, . . t„ which 
ekqpse. Accordingly, it is possible to determine both the total time the candidate takes to 
5 answer all questions qj, q2, - . qn, and the time tskea for the candidate to answer each of 
those questions. 

For at least some of the questions the candidate is prompted to mdicate their 
confidence that the answer given was correct Preferably, computer 1 prompts for such 
an indication for at least half of questions qi, q2, . . qn* Howev^, in tests where there 

10 are a large number of questions computer 1 prompts for the indication of confidence less 
often. Preferably, the confidence indications are sought in reject of the hardest of each 
type of test. In this embodiment computer 1 prompts for an indication of confidence for 
each question qi, q2, . . q„. This leads to a plurality of confidence indicators which, for 
convenience, will be designated as C], C2, c^. Once the candidate has answered the 

15 questions q^ qi* * . -» qn> computer 1 stores answers ai, a2, . . a„» time periods tj, t^, . . t„ 
and confidence indicators C], C2, . . ., Cp in a predetermined file for subsequent processing. 

More particularly, each answer is allocated a score which is weighted in 
accordance with a predetermined scale, bi the present embodiment all the weightings 
are equal. In the event the answer chosen by the candidate is the correct one, then the 

20 score is allocated to the candidate. The value of all the scores allocated to the candidate 
are then added together to provide a total score T,. In this embodimmt T^ is expressed as 
a percentage and lies within the range of 0 to 1 00%. 

Separately, indicators Ci, C2, ...» Cn are processed to provide an overall indicator for 
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confidence for that particular candidate, which will be refored to as T^. In this 
embodiment the confidence indicators correspond to each answer and are allocated the 
same respective scores, in that they weighted the same as the corresponding answer. The 
resulting overall confidence indicator is expressed as a percentage and falls within the 

5 range of 0 to 1 00%. In other embodimmts where a confidence indicator is not obtained 
for each answer, the overall confidence indicator is derived fix>m a weighted average 
of the separate confidence indicators that are obtained. 

In this embodiment, when obtaining an indication of the confidence of the 
candidate that an answer is correct, ihe candidate must select fix)m one of at least three 

10 discrete confidence bands. In more preferred embodiments the candidate must select 
fix>m one of at least five confidence bands. These bands are quantified in percoitage 
terms. For example, one particular multiple choice question presents two alt^atives 
firom which to choose the answer. In this case the lowest confidence band has a lower 
limit of 50%, which corresponds to a guess. However, in other questions there are five 

IS alternatives fit>m which to choose an answer, and the lowest confidence band has a lower 
limit of 20%, which also corresponds to a guess. In all cases the upper limit of Ihe upper 
confidence band is 100%. 

The total score Ts for the candidate is adjusted in accordance with the overall 
confidence indicator T^ to provide a final result or a self monitoring score Tg„ for die 

20 test. Accordingly, the T^m provides an indication of the level of self monitoring achieved 
by the candidate. 

In some tests Tsm is calculated in the foUowmg manner. First, the total score Tg is 
expressed as a percentage of the maximum possible total score. Second, the confidence 
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or self monitoring is expressed as an average percentage for each of the indications 
provided, whether that occurred after each question or only a selected number of 
questions. The final resuU T^^ is then calculated in accordance with the formula: 

5 which lies within the range of 0 to 100%. 

is indicative of the extent to which the candidate has insight into what he or 
she does or does not know with respect to the questions in the test This indication is 
used, in combination with T^ and T^ in isolation, to assist in the assessmmt of the 
candidate for either certain tasks or, if the position in question is well defined, for that 

10 position. In some circumstances it is known to predefine a range of suitable Tg„ that is 
!q)propriate for a position based upon the tasks that are needed to be carried out. In the 
event the test yields a in that range the candidate is considered suitable. 

Generally, a low is favourable, although difTerent positions have diffoCTt 
sensitivities and acceptable ranges. For some tests and positions in the range of 0 to 

IS 7 is considered ideal, while a T„„ in the range of 8 to 12 is acceptable. This efifect is, 
however, modulated by the accq>table levels specified by the organisation offering the 
position in question. 

The apparatus and meOiod according to the invention have been developed in 
conjunction with, and are particularly suited, although not limited, to canying out tests 

20 which have been recently developed by Dr Lazar Stankov. These test are referred to as 
Stankov's Tests of Cognitive Abilities. The tests are designed to be short, cover a 
reasonably broad range of cognitive abilities and provide a maximum amount of 
information to the personnel selection professionals. The questions and techniques used 
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are intended to assist in obtaining an indication of the candidate's ability to make 
decisions under conditions of uncertainty, their mental speed, and their mental capacity. 

More particularly, Stankov's of Cognitive Abilities are based upon the 
theory of fluid and crystallised intelligence (G/Gc theory). This widely accepted theory 

5 states that intelligence is multi-&ceted and is made up of a number of abilities which 
affect our performance educationally, socially and in the ^'world of work". The theory 
enunciates a number of distinct types of broad abilities and that these involve different 
cognitive processes, share different predictive validities and are differentially sensitive to 
intervention. These abilities also ^pear subject to different sets of learning and genetic 

10 influences. The ei^t broadly identified abilities are: 

1. fluid ability (G^; 

2. crystallised ability (Gc); 

3. broad visualisation (Gy); 

4. broad auditory function (GJ; 

IS S. short term acquisition and retrieval (SAR); 

6. tertiary storage and retrieval (TSR); 

7. broad speediness function (GJ; and 

8. broad quantitative ability (Gq)« 

Stankov's Tests of Cognitive Abilities are mostly concerned with Gf, Gc and Gq. 
20 From a statistical point of view each ability is equally inq>ortant However, most 

work has focused on the fluid and crystallised abilities, which share important common 
features. For example, both are characterised by processes of perceiving relation^ps, 
logical reasoning, abstraction, concept formation, problem solving and the like. 
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Moreover, both can be measured by timed tests or power, that is untimed, tests. The 
testing can take the form of material presented in any of the following: pictorial-spatial; 
verbal-symbolic; or veifoal-semantic. 

The main distinguishing feature between Gf and Gg is the amount of formal 
5 education and acculturation that is present either in the content of, or operations required 
during, the tests used to measure these abilities. It is well established that Gf depends to 
a much smaller extent on formal education experiences than does G^. 

Gf and Gc also show distinct developmental trends during adulthood* Thus, while 
Gc remains constant or show slight increment aver the course of an individual's life 

10 span, Gf generally declines as a function of age. This may largely be accounted for by 
the proposed mechanisms underlying the G/Gc distinction. While Gf is bought to 
dq)end on the cq>acity of working memory, Gc is thought to depend on flie long-term 
memory store and the organisation of information within that store. Working memory 
deteriorates with age as a function of neurological decay, while long term store is less 

15 prone to such effects. 

According to G|/Gc theory, the presence of broad abilities other than Gf and Gc 
indicates that performance on all cognitive tasks depends not only on ^lugher*' mental 
processes, but also on processes that have been viewed as ^lower*' level functions in 
more traditional theories of intelUgence. For example, the existence of G^ and Gv 

20 indicates that some people are more efScieht at processing information that is auditory in 
nature, whilst others are more efficient at processing information acquired through the 
visual medium. 

The theory is discussed in more detail in the following references, the disclosure of 
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wUch is incorpoiated herein by way of cross reference: 

Carroll, LB. (1913). Human Cognitive Abilities: A Survey of Factor- Analytic 
Studies . New York: Cambridge University Press; and 

Horn, JX., & Noll, J. (1994). A system for understanding cognitive capabilities: 
5 A theory and tiie evidence on which it is based. In D.K. Detterman, (Ed), Cmrent Tonics 
in Human Intellieence: Volume IV: Theories of Intellipence , Norwood, NJ: Ablex 
Publishing Corporation. 

Stankov's Tests of Cognitive Abilities include a battery of tests for measuring 
three broad abiUty factors that are deemed essential for successful performance in a wide 
10 variety of contOTiporaiy working enviroimients. These are: 

1. Fluid intelligence (Gfl, This is measured by two tests! 

a. Sws^stest; 

b. Triplets test 

Both these tests have good psychometric properties and embody sound principles 
15 fiom experimental cognitive psychology. They will be described in more detail below. 

2. Crystallised intelligence (Gc). This is measured hy twn tftsfs- 

c. Vocabulary test; 

d. Proverbs Matching test; 

The Vocabulary test is a common synonyms vocabulary test. The Proverbs test 
20 requires the examinee to match two proverbs according to their meaning or their relevant 
message. 

3. Broad quantitative ability (Gq\ This is measured by two tests: 

e. Numerical Operations; 
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f. Financial Reasoning. 
The Numerical Operations test is a conunon measure of the facility to carry out 
elementary arithmetic operations. The Financial Reasoning test is developed for and is 
most suitable to part of a selection battery for the entry-level jobs in financial 
5 institutions. 

It is possible to classify the above six tests with respect to subjective difficulty. In 
the listing, the first test in each group is usually seen as somewhat easier than the second. 

Stankov's Tests of Cognitive Abilities contain three features that have not been a 
part ofmost previous selection batteries. These are: 
10 1 . Systematic measurement of complexity and difGculty in tests of fluid 

abilities. 

An important aspect of good tests of fluid abilities is tiie ^istence of items that 
systematically vary in difiBculty. This allows for a fine discrimination among 
individuals along the relevant dimension. In the past, fliis gradation was accomplished 

15 by selecting items in the post-hoc way, that is, after piloting the test and during fhe 
process of itmi analysis. Thetests ofthepresentbattery consist of items that are 
selected a priory after the analysis of cognitive processes that are called upon during the 
solution process. This increase in difficulty is directly related to demands placed on 
important capacity constructs like working memory and attentional resources. -Thus, the 

20 SwBp items that require one swap are easier than itmis that require more than oiie swap 
and a similar increase in difficulty is present in the Triplets test Laboratory studies have 
shown that systonatic increase in difficulty is supported by the data. 

Furthermore, the increased item difficulty is also characterised by an increase in 



wo 00/19393 PCT/AU99/00816 

-13- 

the tests* correlations with traditional tests of mtelligence. In other words, they also 
increase in complexity. This increase in correlation is not a necessary feature of the 
increase m difficulty - in most tests of intelligence easy items have the same correlation 
with the IQ scores as do the difficult items. For that reason, the present tests have an 

5 advantage over the older tests - they can measure a wide range of difficulty and, at the 
hardest level, the items are improved measures of fluid abilities for theoretically 
important reasons. On the applied side, we now know tiiat these two tests are usefiil 
assessment devices during the different stages of recovery from brain injury. 
2. Measurement of speed of test-taking. 

10 Much of the recent work on intelligence is directed at establishing the ^pirical 

link between fluid intelligence and speed of mental oponations. It is inq)ortant to keep in 
mind the fact that speed is not a unitary construct - ibisro are several types of mental 
speed and each one of these may have different relationship to intelligence. While the 
measurement of mental speed is important from both theoretical and practical points of 

IS view, it is wrong to see mental speed as the basic process of intelligence. The presmt 
battery measures one of the mental speed constructs - the speed of test-taking. 

From the practical viewpoint, the information on the speed of test-taking may be 
usefiil for the selection of personnel for jobs requiring a quick decision under time 
pressure. It is also useful to compare people with respect to speed-accuracy trade-off 

20 that is, are those who are quick also prone to committing more enors: Finally, it is also 
known that speed of mental processing is closely hnked to the age-related cognitive 
changes in the human organism. Older people are considerably slower than young. 
However, there are significant individual differences in the aging process. The 
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information about the speed of test taking may be useful in selecting older people who 
have retained the speed characteristic of the younger members of the population. 

3. Measurement of self-confidence and self-monitoring. 

Three tests in this battery provide information about the self-confidence in the 
5 answers provided to test items. This work derives fix>m research on decision making 
under conditions of uncertainty. Confidence rating scores on their own provide an 
indication about the ego-related personality trait of self-confidence which is located 
somewhere on the borderline between personaUty and intelligence. In many situations, 
the accuracy of one's assessment of the situation is not the only or even the most 
10 important information that directs action. Confidence in that judgement may be the 
critical feature. Furthemore, the diffonence between accuracy scores and confidence 
are provided in the report section tell us how good we are in knowing what we know and 
what we do not know. This difference or bias is the information about self-motiitoring. 
Some people have good insight into their own performance while others show a 
15 pronoimcedbias. 

It can be expected that people with higih self-confidence tend to be 'Managerial 
material"' in organisations. They should show more initiative and, in general, provide 
leadmhip in team work. 

The design of this battery of tests was guided by the following consid^tions: 
20 a. Relatively quick assessment of cognitive abilities. On average a 

respondent should be able to complete each test within ten minutes. 

b. Reliable for a wide range of jobs. 

Overall, the tests of this battery represent a sample of abiUties that are captured by 
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flie general factor and contain considerably more information than what can be easily 
obtained from known tests. 

Each of the individual tests in Stankov's Tests of Cognitive Abilities are 
performed through use of the invention. That is, the tests are embodied in a computer 

5 program which, once initialised, runs on computer 1 . The candidate is sequentially 
presented with a series of questions from one or more of the Stankov's Tests and 
prompted to select an answer. The Swaps test involves displaying on screen 3 an array 
of at least three linearly spaced apart visually distinct figures or pictures, as well as a set 
of instructions. The instructions ask the candidate to carry out a mental sws^ of the 

10 figures and to prompt the computer once they wish to provide and answer. Once so 
prompted, the instructions and array are no longer displayed, but rather a numb^ of 
altemative arrays are shown with different relative positioning of the pictines. The 
candidate must them select one ofthealtonative provided. Once this answer is provided 
computer 1 displays the next question. Generally, one or both of the number of pictures 

IS. and the complexity of the instructions progressively increases for subsequent questions. 
In this particular embodiment each array in the dififerent questions includes three 
pictures. 

The time taken for the candidate to review and answer each question is measured 
by computer 1 . Moreover, in this embodiment conq)uter 1, aftCT each question, asks tibie 
20 candidate to indicate thdr level of coiifidence that the aiiswer was correct Inoth^ 
embodiment the level of confidence is not measured for the Swaps test. 

Once the Swaps test is completed, computer 1 automatically progresses to the 
Triplets test The input provided.by the candidate to computer 1 during the Swaps and 
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Triplets test are compiled and processed to give the following: 

• Swaps Accuracy (%) = the number ofcorrect answers divided by the total 
number of questions; 

• Swaps Reaction Time (seconds) = the sum of the time taken to answer each 
5 question, divided by the total number of questions; 

• Triplets Acciu:acy(%) = the number ofcorrect answers divided by the number 
of questions; 

• Triplets Reaction Time (seconds) = the sum of the time taken to answer each of 
the questions, divided by the total number of questions; 

10 • Triplets Self Confidence (%) = the sum of the confidence ratings for each 

question attempted divided by the total number of questions; and 

• Triplets SelfMdnitoring(%) = Triplets SelfConfidence minus Triplets 
Accuracy. 

Once the Triplets test is completed computer 1 progresses to the additional tests to 
15 gain indicators to Crystallised Intelligence. The input provided by the candidate to 
during these tests are compiled and processed to give the following: 

• Vocabulary Accuracy (%) = the number ofcorrect aiiswers divided by the total 
number of questions in the test; 

• Vocabulary Reaction Time (seconds) - the sum of the time taken to answer 
20 each of the questions, diyided by the total number of questions; 

• Proverbs Matching Accuracy (%) = the number of correct answers divided by 
the total number of questions in the test; 

• Proverbs Matching Reaction Time (seconds) - the sum of the time taken to 
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answer each question, divided by the total number of questions; 

• ProvCTbs Matching Self Confidence (%) = the sum of the confidence ratmgs for 
each question attempted divided by the number of questions attempted; and 

• Proverbs Matching Self Monitoring (%) = Proverbs Matching self confidence 
5 minus Proverbs Matching Accuracy. 

Computer 1 then progresses to the final tests to gain indicators to Quantitative 
Knowledge. The input provided by the candidate during these tests are conq)iled and 
processed to give the following: 

• Numerical Operations Accuracy (%) = the number of correct answers divided 
10 by the total numbo- of questions in the test; 

• Numoical Operations Reaction Time (seconds) - the sum of the time taken to 
answer each question, divided by the total number of questions; 

• FiiiancialReasoiiing Accuracy (%) = the number of correct answars divided by 
the total number of questions in the test; 

15 • FiiiancialReasoiiing Reaction Time (seconds) the sum oftfae time taken to 

answer each question, divided by the total number of questions; 

• Financial Reasoning SeIfConfidence(%) = the sum ofthe confidence ratings 
for each answer divided by the number of questions; and 

• Financial Reasoning SelfMonitoring(%)=' Financial Reasoning Self 
20 Confidmce minus Financial Reasoning Accuracy. 

Once all the tests are complied computer 1 produces sununary statistics for the 
candidate which, in tihis embodunmt^ include the following: 

• Fluid Intelligence 0>mentage correct) - the sum of the accuracy scores for 
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Swaps and Triplets, divided by two (2); 

• Crystallised Intelligence Q>ercentage correct) = the sum of the acci^ 
for Vocabulary and Proveib Matching, divided by two (2); 

• Quantitative Knowledge (percentage correct) - the sum of the accuracy scores 
5 for Numerical Operations and Financial Reasoning, divided by two (2); 

• Speed (seconds) = the suim of the speed scores for all tests divided by six (6); 

• Overall Self Confidence (%) = the sum of all Confidence Ratings for Triplets, 
Proveibs Matching and Financial Reasoning, divided by three (3); and 

• OvCTall Self Monitoring (%) = overall self confidence for Triplets, Proverbs 
10 Matching and Financial Reasoning minus the overall accuracy for the same 

three tests. 

The results provided by computer 1 can be represented in tabular, graphical or 
other forms. Examples of such results for candidates c, d, e and fare provided in Tables 
1, 2, 3 and 4. In this embodiment the tabulated results are not displayed to the candidate. 
15 In other embodiments some or all ofthe data is so displayed. 

Reference is also made to Table 5 which sets provides a brief explanation ofthe 
indications provided by the various tests outlined above. 

The invention, through the use of time measurement, self confidence ratings and a 
derivation of a measure of self monitoring, allows the assessor to gain a greater insight 
20 into cognitive ability of tibe candidate. Unlike the prior art systems, reliance need not be 
placed only upon the number of correct answers and the total time taken to conduct a 
test. 

In some embodiments, and as illustrated in Figure 2, a plurahty of like computers 1 
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are interconnected in a LAN to allow simultaneous testing of a plurality of candidates. 
In the configuration shown, computers 1 are interconnected by cabling 6 and centrally 
controlled by a server 7. 

Although the invention has been described with reference to a specific example, it 
5 will be appreciated by those skilled in the art that it may be embodied in many other 
forms. For example, the results, in some embodiments, are expressed both in relative 
and absolute terms. That is, not only are the actual results of the test for each candidate 
provided, but how that candidate performed relative to other candidates who underwent 
the same test 
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Table 1 



FLUID INTELLIGENCE 


Name 


Swaps 
Accuracy 


Swiq>s 
Reaction 


Triplets 
Accuracv 


Trqilets 
Reactinn - 


Triplets Self- 


Triplets Self- 

jvioiiiionug 


c 


56% 


17.66 sec 


89% 


2.95 sec 


95% 


6% 


d 


28% 


15.84 sec 


94% 


3.36 sec 


67% 


-27% 


b 


18% 


24.24 sec 


83% 


6.67 sec 


66% 


-17% 


e 


18% 


10.66 sec 


87% 


3.74 sec 


99% 


-12% 


a 


62% 


16 JO sec 


90% 


3.40 sec 


67% 


-23% 


f 


15% 


17.07 sec 


25% 


5.43 sec 


72% 


47% 


Norm 
Average 


38% 


16.9 sec 


4.0 sec 


4.0 sec 


95% 


8% 


Table 2 


CRYSTALLISED INTELLIGENCE 


Name 


Vocabubiy 
Accuta^ 


Vocabulary 
Reaction 


Proverbs 
Accuracy 


Proverbs 

Reaction 


Proverbs Self- 

Confidence 


Provobs Self- 
Monitoring 


c 


80% 


5.92 sec 


60% 


23.66 sec 


60% 


0% 


d 


. 90% 


7,26 sec 


- 20% 


29.53 sec 


43% 


23% 


b 


60% 


18.32 sec 


25% 


30.53 sec 


42% 


17% 


e 


93% 


4.20 sec 


65% 




98% 


33% 


a 


73% 


9.51 sec 


45% 


27.53 sec 


81% 


36% 


f 


23% 


7.32 sec 


25% 


10.77 sec 


70% 


45% 


Nonn 
Average 


69% 


9.7 sec 


39% 


22.1 sec 


55% 


10% 


Tables 


QUANTITATIVE KNOWLEDGE 


Name 


Numerical 
Accuracy 


Numerical 
Reaction 


Financial 
Accuracy 


Financial 
Reaction 


Financial Self- 
Confidence 


Financial Self- 
M<Mutoring 


c 


82% 


11.01 sec 


25% 


41.24 sec 






d 


36% 


11.48 sec 


16% 


53.54 sec 






b 


62% 


11.33 sec 


0% 


61.65 sec 


7% 


7% 


e 


70% 


11.11 sec 


25% 


5138 sec 


42% 


17% 


a 


82% 


11.07 sec 


58% 


48.98 sec 


83% 


25% 


f ' 


14% 


11.75 sec 


8% 


35.16 sec 


68% 


60% 


Nonn 
Average 


57% 


15.3 sec 


.29% 


45.8 sec 


53% 


30% 
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Table 4 



SUMMARY STATISTICS 


Name 


Fluid Gf 


Crystallised 
Gc 


Quantitative 

Gq 


Speed Gs 


Overall Self- 

Confidence 


Overall Self- 
Monitoring 


c 


73% 


70% 


54% 


17.07 sec 






d 


61% 


55% 


26% 


20.17 sec 






b 


51% 


43% 


31% 


25.46 sec 


38% 


2% 


e 


53% 


79% 


48% 




80% 


21% 


a 


76% 


59% 


70% 


19.47 sec 


77% 


13% 


f 


20% 


24% 


11% 


14.58 sec 


70% 


51% 


Noon 
Average 


59% 


54% 


43% 


18.7 sec 


67% 


9% 



Tables 



Test Name 


Score 


Explanation/comments 


Swaps 
Accuracy 


High 
80% 


Indicates above average ability to hold in tnind several bits 
of infonnation and manipulate elemmts of the task in 
working memory 




AVERAGE 






Low 
20% 


Indicates below average ability to hold in mind several bits 
of information and manipulate elements of the task in 
woridngmemoiy 


Swaps 

Reaction Time 


High 

80%+ 


Fast thinker - above average speed of manipulating 
elements while holding several bits of information in 
working memory 




AVERAGE 






Low 
20%- 


Slow thinker - below average speed of manipulating 
elements while holding several bits of information in 
working memoiy . 


Triplets 
Accuracy 


HlGH 
80% 


Indicates above average ability to keep in mind a rule for 
doing a particular mental operation and examine the 
problem in order to establish if the rule is satisfied. 




AVERAGE 






Low 
20% 


Indicates below average ability to keep in mind a rule for " 
doing a particular mental operation and examine the 
problem in order to establish if the rule is satisfied. 


Triplets 
Reaction Time 


High 


Fast thinker - above average speed when there is a need to 
keep in mind a rule for doing a particular mental operation 
and examine the problon in order to establish if flie rule is 
satisfied 




Average 
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TableSCont. 



Test Name 


Score 


Explanation/comments 




Low 


Slow thinker - below average speed when there is a need to 
keep in mind a rule for doing a particular mental operation 
and examine the problem in order to establish if the rule is 
satisfied. 


Triplets Self 

CONnOENCE 


High 
80% 


Above average belief in one's ability to keep in mind a rule 
for doing a particular mental operation and examine tiie 
problem in order to establish if the rule is satisfied 




Average 






Low 
20% 


Above average belief in one's ability to keep in mind a rule 
for doing a particular mental operation and examine the 
problem in order to establish if the rule is satisfied. 


Triplets Self 
Monitoring 


Higher 
than 
10% 


Relatively poor ability to monitor one's performance in 
tasks requiring the ability to keep in mind a rule for doing 
a particular mental operation and examine the problem in 
order to establish if die rule is satisfied 




10% 


Satisfactory ability to monitor one's performance in tasks 
requiring the ability to keep in mind a rule for doing a 
particular mental operation and exanune the problem in 
order to establish if the rule is satisfied. 


Vocabulary 
Accuracy 


High 
80%+ 


Indicates a good underatanding of word meanings 




Average 






Low 
20%- 


Indicates poor understanding of word meanings 


Vocabulary 
Reaction Time 


HlGH 
80%+ 


Indicates speed of retrieving and applying acquired 
(stored) knowledge. 




AVERAGE 






Low 
20%. 


Indicates slow speed of retrieving and applying acquired 
(stored) knowledge 


Matching 
Accuracy 


80% 


Stron? abilitv to understand word meanincs at an advanced 
level, to understand the meanings conveyed by proverbs, 
and match two proverbs according to their meaning 




AVERAGE 






Low 

20% 


Poor ability to understand word meamngs at an advanced 
level, to understand the meanings conveyed by proverbs, 

and match two proverbs according to their meaning. 


Proverbs 
Matching 
Reaction Time 


High 
80% 


Fast thinker - quick to understand word meanings at an 
advanced level, to understand the meanings conveyed by 
proverbs, and match two proverbs according to their 
meaning. 
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Table 5 Cont. 



Test Name 


Score 


Explanation/comments 




Average 






Low 
20%- 


Slow thinker - slow to understand word meanings at an 
auvoii^cu icvci, w uiiuvrouuiii uic meanings convcYcQ oy 
proverbs, and match two proverbs according to fheir 
meaning. 


Matching Self 

CONnDENCE 


80%+ 


/\uuvc <tYciagc ociiei.ui one s aDiii^ lO iQiow uiaT uie 
decisions regarding the meanings of proveibs are correct or 
incorrect 




AVERAGE 






20%- 


Dciovf average ueiiei in one s aDiniy lo Know tnat me 
decisions regarding the meanings of proverbs are correct or 
incorrect 


JrKOVERBS 

Matching Self 
Monitoring 


HIGHER 

THAN 
10% 


Relatively poor ability to monitor one's performance 
regarding the meanings of proverbs 




Average 






A mo/ 


. . . . 

Indicates an accurate perception of the quality of answers 
given. A realistic awareness of flie ability to monitor one's 
performance regarding tiie meanings of proveibs 


Numerical 
Operations 
Accuracy 


High 
80% 


Indicates strong ability to solve basic mathematical 
problems 




Average 






Low 
20% 


Indicates poor ability to solve basic matfiematical 
problems. 


Numerical 
Operations 
Accuracy 
Reaction Time 


High 
80% 


Fast thinker - high speed of solving basic mathematical 
problems. 




AVERAGE 






Low 
20% 


Slow thinker - slow speed of solving basic mathematical 
problems 


Financial 

Reasoning 

Accuracy 


High 
80% 


Indicates strong ability to reason with problems of 
financial and mathematical nature 




AVERAGE 






Low 

20% 


Indicates poor ability to reason with problems of financial 
and mathematical nature 


Financial 


High 


F ast thmker - above average speed of reasoning with 
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Table 5 Cont 



Test Name 


Score 


Explanation/comments 


Reasoning 
Reaction Time 


80%+ 


problents of financial and mathematical nature. 










Low 
20%- 


Slow thmker - below average speed of reasonmg wifh 
problems of financial and mathematical nature 


FiNANaAL 

Reasoning Self 
Confidence 


High 
80% 


Above average belief in one's ability reason with problems 
of financial and matfiematicail nature 




Average 






Low 
20% 


Below average belief in one's ability reason with problems 
of financial and mathematical nature 


Financial 
Reasoning Self 

MONITORmG 


Higher 

THAN 

10% 


Relatively high ability to monitor one's performance in 
tasks that require reasoning with financial and 
mathematical problems. 




0-10% 


Relatively poor ability to monitor one's performance in 
tasks that require reasoning wifh financial and 
mathematical problems 


Fluid 

Intelligence 


High 
80% 


Indicates above average learning potential. Strong ability to 
solve novel problems. Strong ability to solve problems 
which are nredominantlv unrelated to oast education 
Suggests that the individual is highly competent at carrying 
out such processes as poiceiving relationships, logical 
reasoning and problem solving with nonverbal material. 
Indicate advanced working memory capacity (ability to 
mentally hold and organise information to solve problems), 
and the amount of attentional resources (focus moital 
energy to solve tasks). 




Average 






Low 
20% 


Indicates difficulty in learning new tasks. Relatively poor 
ability to solve novel problems and difficulty in solving 
problems which are unrelated to past education. Suggests 
that the individual struggles at carrying out such processes 
as perceiving relationships, logical reasoning and problem 
solving with nonverbal material. Indicates below average 
working memory capacity (ability to mentally gather and 
organise information to solve problems) and Ae amount of 
attentional resources (focusing mental energy to solve 
tasks). 
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CLAIMS 

1 . An ^paratus for conducting a test on a candidate, the apparatus including: 
first means for presenting a series of questions to the candidate; 

5 second means for obtaining fiom the candidate an answer to each of the questions; 

and 

timer means for determining the time taken for the candidate to answ^ each of the 
questions. 

2. An apparatus according to claim 1 including third means for obtaining from the 
10 candidate an indication of their confidence that any one or more of the answers were 

correct. 

3. An qiparatus for conducting a test on a candidate, the apparatus including: 
first means for presenting a series of questions to the candidate; 

second means for obtaining fix>m the candidate an answer to each of the questions; 
15 diird means for obtaining &om the candidate an indication of their confidence that 

any one or more of the answers were correct; and 

timer means for determining the time taken for the candidate to answer ttie 
questions. 

4. An sqiparatus according to claim 2 or claim 3 wherein the fliird means obtains a 
20 confidence indication for each of the questions. 

5. An s^aratus according to claim 2 or claim 3 wherein, once all the answers have 
been obtained from the candidate, the third means provides an overall confidraice 
indicator for that candidate. 

6. An apparatus according to claim 5 who^in the third means derives the confidoice 
25 indicator fix>m the indications ofconfidence provided by the candidate. 
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7. An apparatus according to claim 6 wherein the third means derives the confidence 
indicator firom selected ones of the indications of confidence provided by the candidate. 

8. An apparatus according to claim 6 wherein the third means obtains fix>m the 
candidate an indication of their confidence that selected ones of the answers were 

s correct, where that selected number is less than the nurnb^ of questions presented to the 
candidate. 

9. An ^paratus according to claim 3 wherein the timer means determines the time 
taken for the candidate to answer each question. 

10. An apparatus according to claim 3 wherein the first means sequentially presents 
10 the series of questions. 

11 . An qiparatus according to claim 3 wherein the answers to the questions, once 
provided by the candidate, can not be changed. 

12. An apparatus according to claim 2 or claim 3 wherein the third means allows the 
candidate to nominate one of a plurality of confidence bands which best corresponds 

IS with their confidmce that an answer was correct. 

13. An apparatus according to claim 12 wherein at least some of the questions are 
multiple choice and the number of choices being available corresponds to the number of 
confidence bands. 

14. An apparatus according to claim 2 or claim 3 wherein the third means pronqits the 
20 candidate to provide a number within a predetermined range to indicate their degree of 

confidence. 

15. An apparatus according to claim 2 or claim 3 including fourth means responsive to 
the first means, the second means and the timer means for indicating the results of the 
test. 
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16. A method for conducting a test on a candidate, the meAod including the steps of: 
presenting a series of questions to the candidate; 
obtaining from the candidate an answer to each of the questions; and 
det^mining the time taken for the candidate to answer each of the questions. 
5 17. A method according to claim 16 including the additional step of obtaining from the 

candidate an indication of their confidence that any one or more of the answers, were 

correct 

18. A method for conducting a test on a candidate, the method including the steps of: 
presenting a series of questions to the candidate; 
10 obtaining from the candidate an answer to each of the questions; 

obtaining from tiie candidate an indication of their confidence that any one or more 
of the answm were coirect; and 

determining the time taken for tiie candidate to answer the questions. 
19 A method according to claim 17 or claim 18 including the step of determining tiie 
IS time taken for the candidate to answer each questioiL 

20. A method according to claim 17 or claim 18 wherein the series of questions is 
sequentially presmted. 

21. A method according to claim 17 or claim 18 whoein the answers to the questions, 
once provided by the candidate, can not be changed. 

20 22. A metiiod according to claim 17 or claim 18 wherein the candidate must nominate 
one of a plurality of confidence bands which best corresponds with tiieir confidence that 
an answer was correct. 

23. A method according to claim 22 wherein at least some of the questions are 
multiple choice, wherein the number of choices being available corresponds to the 
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number of confidence bands. 

24. A method according to claim 17 or claim 18 wherein the candidate is prompted to 
provide a number within a predetermined range to indicate their degree of confidence. 

25. A method according to claim 17 or claim 1 8 including the stq) of indicating the 
5 results of the test 
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